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(54) Digital watermarking technique 

(57) A watermarking system allowing both suffi- 
ciently high quality of watermarked moving pictures and 
enhanced ease of watermark detection is disclosed. A 
watermark level of a watennark to be embedded into a 
picture of data is changed depending on the picture type 
of a selected block of frequency component data, and 
then a watermark having the watenmark level is inserted 
into the selected block of frequency component data. 

FIG.1 



Therefore, a moving-picture can be effectively embed- 
ded with a digital watennark without substantially reduc- 
ing the quality of image and the digital watermark can 
be detected reliably. A relative proportion of watemiark 
levels of l-picture, B-picture, and P-picture is preferably 
set to 10:7:5. 



ORIGINAL IMAGE 
,101 



1 1 1 WATERMARKED IMAGE 



BLOCK 102 
106 

L_ 



103 

Jl 



104 

-L 



QUAf4- 
nZATlON 



PICTURE 

TYPE 

DECISION 



105 



INSERTION 



PKmiRETYPEX 



BLOCK 
L0CATK3N 



109 

INVERSE 

QUAN- 

TT2ATTON 



110 

( 






lOCT 




— V 



113 



112 



SELECTH) 
WATERMARK 

wi(X) 



r 




HUFFMAN- 




. ' 

COMPRESSED 
DATA 


CODING 





WATERMARK 
SELECTOR 



-^107 



114 



106 



WATERMARK TABLE 


W(I) 




W(P) 


W,(l) 


Wi(B) 


Wi(P) 


Wad) 


W2(B) 


W2(P) 










Wn{B) 


Wm(P) 



IW(l)t 



IW(B)I : IW(P)t 
.10 : 7 : 5 ^ 



BEST AVAILABLE COPY 



o. 

LU 



Printed by XeKW<UK) Business Sefvioes 
2.16.7 <HnS)/3.6 



EP 1 079 633 A2 



Description 

[0001] The present invention relates to digital 
watermarking of moving-picture data and in particular to 
a method and system for inserting watermark data into 
the moving-picture data. 

[0002] With wide-spreading digital satellite broad- 
casting. Internet transmission and DVD (Digital Video 
Disk), etc. in recent years, dig'rtal images are becoming 
easily accessible to users. Since the quality of digital 
images does not deteriorate when they are copied, 
securing their copyrights has been an important issue. 
[0003] For purposes of securing copyright protec- 
tion for MPEG (moving picture experts group) data, 
there have been disclosed a watennarking system for 
embedding a plurality of watermarks into DCT (discrete 
cosine transform) coefficient domain of MPEG data and 
a watermark detecting system for extracting and detect- 
ing the embedded watemmarks from the watermarked 
MPEG data (see JP-A-1 1 -55639). 
[0004] More specifically, a plurality of watermarks 
different from each other are previously stored each cor- 
responding to picture types (I-. B-, and P-pictures in 
MPEG). In the watermarking system, one watennark is 
selected from the plurality of watenrorks depending on 
the type of a picture to be encoded and is embedded 
into the image data in units of 8 x 8 DCT coefficient 
block. 

[00051 Assuming that f(1 ), f(2) f(n) are DCT coef- 
ficients listed in frequency-ascending order, a water- 
marked coefficient F(i) is calculated by the following 
equation: 

F(i) = f(i) a X avg(f(i)) x w(i), 

where i = 1 . 2. 3 n. w(i) is an element of a water mark 

selected according to a normal distribution with mean 
mx = 0 and variance = i , a is a scaling element, and 
avg(f(i)) represents a local average over three DCT 
coefficients in the neighborhood, which is calculated by 
the following form: 

avg(f(i» = (If (i-1 )l + If 0)1 + )" V3. 

[0006] On the other hand, the watermark detecting 
system can detect an embedded watenmari< without the 
need of the original image data. The watermarked 
MPEG data is decoded and a watermark is extracted 
from the DCT components of the decoded data using 
the local average over the neighborhood. A watermark 
element W(i) is extracted by calculating the following 
form: F(i)/avg(F(i)). A watermartc element W(i) is accu- 
mulated in one frame/field to produce WF(i). 
[0007] A statistical similarity C between w(i) and 
WF(i) can be calculated using vector inner product as 
follows: 



C = WFxfr/{|WFlx|Kl), 

5 Where WF = (WF(1). WF(2) WF(n)) and w = (w(1). 

w(2) w(n)). 

[0008] If the statistical similarity C calculated as 
described above exceeds a predetenriined threshold, it 
is determined that the con-esponding watemnari^ is 

70 embedded in the MPEG data. 

[0009] However, the inventor found that a degree of 
embedded watennark effect on MPEG data is varied 
depending on the type of a picture in MPEG. If water- 
mark frequency coefficients having a certain amplitude 

75 (level) is uniformly embedded to MPEG data regardless 
of the type of a picture as the prior art, then there are 
cases where the quality of image is deteriorated and the 
embedded watermark is hard to be detected. 
[0010] More specifically, when the watemnaric is 

20 Strongly embedded to the MPEG data, ease of water- 
mark detection is enhanced but the quality of image is 
deteriorated. Contrarily when the watemiark is lightly 
embedded to the MPEG data, the quality of image is 
kept sufficiently but the embedded watermark becomes 

25 hard to be detected. In other words, the quality of a 
watermarked image is traded off against watemriart< 
detection efficiency 

[001 1 1 It is an object of the present invention to pro- 
vide a watermarking system and method allowing both 

30 sufficiently high quality of watermarked moving pictures 
and enhanced ease of watermartc detection. 
[001 2] According to the present invention, a method 
for inserting a watennark into a selected block of fre- 
quency component data in a picture of data having one 

35 of a plurality of picture types, includes the steps of: 
determining a picture type of the selected block of fre- 
quency component data; determining a watermark level 
depending on the picture type of the selected block of 
frequency component data; and inserting a watermartc 

40 having the watermartc level into the selected block of fre- 
quency component data. 

[0013] The picture types are preferably Intra-frame 
coding picture (hereafter, l-picture), Inter-frame Predic- 
tive coding picture (hereafter, P-picture) and Bidirection- 

45 ally Predictive coding picture (hereafter, B-picture), 
wherein a relative proportion of watennark levels of I- 
picture, B-picture, and P-picture is 10:7:5. 
[0014] As described above, a watemnark level of a 
watermartc to be embedded into a picture of data is 

50 Changed depending on the picture type of a selected 
block of frequency component data, and then a water- 
mark having the watermark level is inserted into the 
selected block of frequency component data. Therefore, 
a moving-pteture can be effectively embedded with a 

55 digital watermark without substantially reducing the 
quality of image and the digital watennark can be 
detected reliably. 

[0015] According to an embodiment of the present 
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u- u Kiork is selected; and inserting a seieciea 

rdepend-^g on a picture type; b) selecting a water^ 
marf o^ a type depending on a picture type of the 
ri^el b.S of frequency con^ponent data; and c) 
fnstSrng a watermark of a selected type .nto the 
selected block of frequency coinponent data. 

According to still another embodiment o the 
^ \- ^„««n a method includes the Steps Of: a) 
present '"TT" ^ w^rrTrk; b) determining a picture 
TeofthleSbS^" frequency component da^^ 
typeoftheseiecieu reference water- 

c) Changing ^^.^'^^'^ of the selected 
Ltk St nVCon^t ^t^o produce a water- 
maS to be usedTand d) inserting the watem^ark to be 
used Into the selected block of frequency component 

?<!1S Ai In the step (c). the watermark level of the ref- 
Sence watelrfmat be changed depending on both 
ZTpZe type of the selected bk>ck of frequency com- 
ponent data and the selected block. 
moi91 According to another aspect of the preseni 
10019] . detectino a watemiark from a 

Of rltem^'ks varies depending on a P.<^u- 
extracting a watermark from the selected block In the 
S^o?data; selecting a watem^ark of a type depend- 

deoending on a picture type; a selector for selecting a 
S^rk of a tj>e depending on a P'^t-e type the 
selected block of frequency component data, and an 
fnseS sSion for inserting a selected watermark of a 
seleSeS type into the selected block of frequency com- 



ponent d^'^^ , -.^.ention, a system 

10 inserting the watermark to be used into 
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30 



35 



40 



RG. 1 is a block diagram showing a ~n«9"f "^J^J 
a watemiark insertion system according to a first 
embodiment of the present invention; 

FIG. 2 is a block diagram showing a configuration of 
a watermark detection system according to the first 
embodiment of the present invention; 

FIG. 3 illustrates a layered stmcture of an MPEG 
Standard format; 

FIG. 4 is a schematic diagram ^hovrtng fo^ 
ward/backward prediction operations mthe t^PEG 
standard fonnat; 

FIG. 5 Illustrates a zigzag-scanning sequence; 

FIG. 6 is a schematic diagram showing ^^^"'P'^ 
of watem^ark insertion operation according to the 
present invention; and 

FIG. 7 is a block diagram showing a ^oni^^o^^on^ 
a watermark insertion system according to a see 
ond embodiment of the present invention. 

,00241 Hereafter, the preferred embodiments of the 
present invention will be described in detail. 



50 



FIRST EMBODIMENT 



rnnwi Referring to FIG. 1, an original image 101 
So?J in arraSd memory is d.ided into a ^u^ 
ss S k X k pixel blocks (here. k=8). which are sequenmHy 
^ ad out^s block image data 102^ The blc^-a^ ^am 
102 is converted into DCT coefficient data by a OCT 
IStion °03 and then the DCT coefficient data « quan- 
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tized by a quantization section 1 04 depending to a 
ture type of the original image 101. The quantized OCT 
coeSnt data is output to a watermark .nsert,on sec- 

^^6^ " A Picture type decision section 106 detects 

SSge?ata102.sencodedina^^^^^^^^^ 
a oredetermined standard such as MPEG or H.261. m 
MpIg2 sS^dard. each frame is one of three types of 
S S-frame coding Picture (hereinafter re^enred 
To^s "'l pTc^re"). Inter-frame Predictive coding Picture 
LfeinaSer refered to as 'P Picture") and BidireaK,n^ 
Sy predictive coding Picture (hereinafter referred to as 

;^S"""'The watemnark insertion section 105 
SSIds a watem^rk selected by a v^atemiark selector 
:^?o the^antized DCT coefficient data. The water- 
ZTse^or 107 selects a watemnark from a wa er- 
mfrk table 108 depending on the block location 
mfon and the pSl^ure type X detected by the p.c- 
tute type decision section 106. 

T^ei The v^termark table 108 contains three 
Eof watemnark. W(l). W(B). and W(P). correspond- 
to Dicture B-picture. and P-picture. respectively 
VhVuplS - «rk W(l) cons-^ts of N watermark, 
w n wld) .. Wn(I). which correspond to the blocks of 
an^'Sult; jS^r^e^v. The B-p.ture watemjark 

W/s/consists of N watemiarks: Wi(B). Wg B) 

S)Xh correspond to the blocks of a B-p.cture 
!eiectively The P-picture watenriark W(P) consols of 
•N wate'arks: W.(P). Wa(P) VVN(P). wl;nch corre- 
spond to the blocks of a P-picture. respectively. A wate;^ 
mark is .Bpresented by a set of watermark DCT 

SSr"^cco,tf.ng to the present embodiment, the 

S proportion of the -P-Jjl'-^SS ':;^P^^^ 
P-picture watemiarks is set to IW(1)I • IW(B)I . IVV(P) 
10 7 • 5 A set of watemiark DCT coefficients. W,(X) 0 

i" 2 ■ or N and X = I. B, or P). « obtained by multiply- 
Tng'a ;;ierence watem^ark W(e) by a Pjct-e^^^^^^^^^ 
level coefficient kj(X), that is. Wj(X) - kj(X) x wie, . 
wherein kj(l) : kj(B) : kj(P) = 1 0 : 7 : 5. 
r00301 For example, the reference watermark W(e) 
r^S be 8-bit data "lOIOIOiO". in which the fiist brt rep- 
Z^l^ me presence/absence of copyright protection. 

^second bH represents pem,issionAinhibrtion of copy- 
ing a^d the third bft represents the limited number of 

"'^T^-ner. the watem^ark-embedded DC^ 
ccSficient data te inverse-quantized by an inverse- 
q^^^ation section 109 and then the output of the 
rnverse-quantization section 109 is converted by an 
Se-DCT (IDCT) section 110 into watermarked 
Smage data 1 1 2. which is stored f °- 
tion as the block 102 of the onginal image 101 By 
r^^eatedly perforniing the above procedure on the 
wS« ovir an entire ftame^ield of the original .mage 
1 01 . a watermarked image 1 1 1 is completed. 



r00321 on the other hand, the watemiark-embed- 
?eV OCT coefficient data is subjected to Huffman^cod^ 
fng by an encoder 113 and the Huffrnan^^o^ng 's 
repeatedly petfomied over the entire fiamert«ld to pro- 
, duce compressed moving-picture data 114 such as 
MPEG data. The compressed moving-picture daj 1 14 
may be stored in a recording medium such as DVD or 
another storage device. 

100331 Referring to FIG. 2. watemiarked oom- 
,0 DiSsed data 201 that was produced as descnbed 
a^^is decoded by a decoder 202 to produce wate - 
STembedded DCT coefficient data. The watermark- 
^^edS DCT coefffcient data is inve,se-quant.zed by 
armvt rse-quantization section 203 and then the ocrtpu^ 
„ o the inve^e-quantization section 203 is --erted ^ 
an IDCT section 204 into watemiarked image date 205 
r00341 The watem^ark-embedded DCT coeff cent 
SHecoded by the decoder 202 is also output to a 
wlermark extraLr 206. The watemiark ext-^ctor 206 
20 ^^ractswatem,arkdataonablock.by.blockb^«from 
Z watem^ark-embedded DCT coefficient data and 
Sores all the extracted watemnark data of a p^ure m a 
memory 207. Thereafter, a watemiark detector 208 
Tads out the extracted watemiark data on a block-by- 
.5 Sock basis from the memory 207 and calculates aja_ 
fiical Similarly C based on the ext^cted wa eona* 
and a registered watermark selected by a wateonark 
selector 209. As described before, by companng the 
SS«ed statistical similarity C with a Predete^";";^^ 
so Seshold. It is detemiined whether the registered water- 
mark is embedded in the block in question. 
So35r The watemiark selector 209 selects water- 
Ta^ data from a watemnark table 210 depen m^^^^^^ 
the block location infomiation and the type X of the pic 
as ture The watemiark table 210 contains the same con^ 
tents as the waterrnark table 108. That is. the 
watermark table 210 contains three kinds of waterma k 
W(l) W(B). and W(P) corresponding to l-P'**"'®' B-P''\ 
3' and P-picture. respectively Each of the 1-. B-. and 
^ P.pi;.ure wTtemnarks W(l). W(B). and W(P) -ns^^ 
N watermarks, that is. {W,(l), W-. ))• W,(B). 
W2(B) Wn(B)). and (Wi(P), W2(P) Wf4{P)). 



OPERATION 

[00361 Hereafter, an operation of the present inven_ 
ion Jill be described, taking an example compressed 
rving^icturedataconformingt^^^^^^^^^^ 

. ^rn^comprraSoSSoto^plGste^^^^^^^^ 
such a structure that a sequence header code SHC « 
followed by a sequence of GOP (group of P|Cture). He e 
data of each frame/field of an image « wrrtten m a p^c 
ture layer following a picture start code (PSC). Each 

55 f rame or field is encoded in one of three types of picture 
format. I picture. P picture, and B picture. 
[00381 AS shown in FIG. 4. in the case of P p.«ure 
Snd B picture, only a difference between the own pirture 



4 



EP 1 079 633 A2 



8 



and a reference picture at a different time instant is 
encoded as image data. Moreover, each picture is sub- 
divided into blocks and each block is subjected to the 
discrete cosine transform (DCT). Then, the DCT coeffi- 
cients are quantized with an appropriate quantizing 
coefficient and the quantized DCT coefficients are sub- 
jected to two-dimensional Huffman coding. 
r0039] The field data of each frame is inside a 
macro block (MB) layer under a slice layer following a 
slice start code (SSC). In the case where a color differ- 
ence format is 4:2:0. the field data of each frame is 
expressed by a total of 6 block layers. 4 block layers 
indicating brightness data Y and 2 block layers indicat- 
ing color difference data Cb and Cr. 
[0040] As shown in FIG. 5. in the case of zigzag 
scanning, quantized DCT coefficients are scanned in a 
sequence of numbers and are converted to a one- 
dimensional sequence of 64 DCT coefficients. The posi- 
tion labeled with "1" in the figure expresses a DC com- 
ponent of the DCT domain. Horizontal spacial 
frequency increases from this position 'V rightward and 
vertical frequency increases from this position "1 ' down- 
ward Thus, zigzag scanning virtually results in a one- 
dimensional sequence in order from low-frequency 
components to high-frequency components. A water- 
mark is embedded to a block of MPEG data by adding 
each of watermark DCT coefficients to a corresponding 
one of the 64 DCT coefficients. 
[00411 Refen-ing to FIG. 6. in the case where an 
, original image Is an l-picture and a j-th block is read out. 
the watermark selector 107 selects the l-picture water- 
mark Wi(l) from the watermark table 108. The water- 
mark insertion section 105 adds the DCT coefficients of 
the selected watem^iark Wj(l) to con-esponding ones of 
the quantized DCT coefficients to produce a water- 
marked l-picture indicated by 1 + W(l). Similarly in the 
case where an original image is a B-picture. the water- 
mark selector 107 selects the B-pteture watemiark DCT 
coefficients Wj(B) from the watermark table 1 08. 
[00421 The watermark insertion section 105 adds 
the selected watermark DCT coefficients Wj(B) to corre- 
sponding ones of the quantized DCT coefficients to pro- 
duce a watemiarked l-picture indicated by B + W{B). In 
the case where an original image is a P-picture. a water- 
marked P-picture indicated by P + W(P) is produced by 
the watermark insertion section 1 05. 
[00431 As described before, the relative proportion 
of the respective levels of I-. B-. and P-picture water- 
marks is not equal. In this embodiment. IW(I)1 : IW(B)I : 
IW(P)I is set to 10 : 7 : 5. Watermart< DCT coeffiaents 

W.(X) 0=1. 2 N and X = I, B. or P) is obtained by 

multiplying reference watemiark data W(e) by a picture- 
dependent level coefficient kj(X). that is. 
W (X) = k j(X) X W(e) , wherein kj(l) : kj(B) : kj(P) = 10: 

7 ■ 5 

[00441 By setting the relative level proportion of the 
watermarics W(l). W(B) and W(P) to 10 : 7 : 5. picture 
degradation can be kept at a minimum while the water- 



mark detection efficiency is kept at a sufficient level. 
[0045] Further, the Inventor found that the larger the 
total of the relative level proportion values. 1 B + P , 
(here 1 + 0 7 -i- 0.5 = 2.2), the greater picture degrada- 
5 tion. Relative to 1 + B + P = 2.2 . picture degradation 
becomes greater in the case of 1 + B + P = 3 . Contra- 
riiy in the case of U B + P = 1.5 . picture degradation 
becomes smaller but an embedded watemiark is harder 
to be detected. 

10 

SECOND EMBODIMENT 



[0046] A watemnarking system according to a sec- 
ond embodiment of the present invention will be 
15 described with reference to FIG. 7. where circuit blocks 
similar to those previously described with reference to 
FIG. 1 are denoted by the same reference numerals and 
the details will be omitted. 

[0047] Referring to FIG. 7. the watermarking sys- 
20 tem according to the second embodiment is formed by 
replacing a combination of the watermartc selector 107 
and the watermari< table 108 in the first embodiment 
with a circuit composed of a memory 301 stonng a ref- 
erence watermark W(e). N multipliers 302. N memones 
25 303. and a watemnark selector 304. 

[0048] The respective watermari<s Wj(X) 0-1.2 

N and X = I B. or P), are obtained by the multipliers 302 
multiplying the reference watermartc W(e) by N picture- 
dependent level coefficients kj(X), that is 
30 W (X) = k 1 (X) X W(e) . More specif teally. in the case of 
l-plcture. the respective multipliers 302 are set at Ml). 
k,(l) and kN(l). Therefore, l-picture watemnarks Wj(l) 
are obtained by kj(l) x W(e). Similarly, in the case of B- 
picture, the respective multipliers 302 are set at ki(B). 
35 k2(B)..... and kN(B). and in the case of P-picture. the 

respective multipliers 302 are set at ki(P). kglP) ana 

kM(P) Therefore, the watermark selector 304 can select 
o^ie of the watemiarks stored in the memories 303 
depending on the location of a block to be embedded 
40 with a selected watermark. This is the same operation 
as the first embodiment. 

[0049] As in the first embodiment. kj(l) : kj(B) : Kj(r) 
is preferably set to 10 : 7 : 5. Therefore, the same 
advantages as the first embodiment are also achieved 
45 in the second embodiment. Further, according to the 
second embodiment, only N memories 303 are needed 
to store the necessaiy watemiarks. Therefore, com- 
pared with the first embodiment, the necessary amount 
of memory can be reduced. 
so [0050] The watermark selector 209 and the water- 
mark table 210 in the watemiark detection system as 
shown in Fig. 2 may be replaced with the circuit com- 
posed of the memory 301 storing the reference water- 
mark W(e). the N multipliers 302. the N nnemones 303. 
55 and the watemnark selector 304. 

[0051] The above-described embodiments have 
been explained taking the MPEG standard coding sys- 
tem as an example, but of course the present invention 
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is applicable to other image coding systems using DCX 
lor example. JPEG standard and H.261 as well. 
ro0521 The watermark insertion and detection 
according to the above described embodiments can 
S be implemented by a computer running a progam 
That instruSs the computer to execute t^^^- 
r00531 As described above, according to the 
^prSent invention, the amplttude or level of a watermar 
to be embedded to moving-picture data .s set to an opt^ 

ma) level for each picture type In the mov.ng-p^ure 
-^Serefore. both sufficiently high P^^lrty ^f v^ter- 

Irked moving picture data and enhanced ease of 

watennark detection can be achieved. 

Claims 

1 A method for inserting a watermark into a selected 
bl^k of frequency component data in a picture of 
data having one of a plurality of picture types, com- ^ 
prising the steps of: 

determining a picture type of the selected block 
of frequency component data: 
detem^ining a watemiark '^^1 depending on 
the picture type of the selected block of fre- 
quency component data; and ^ ^^rt, 
inserting a watenriaik having the watermark 
level into the selected block of frequency com- 
ponent data. 

2 A method for inserting a watermark into a selected 
block of frequency component data in a picture of 
data having one of a plurality of picture types, com- 
prising the steps of: 

storing" a plurality of watemiarks tor each pic- 
ture type, each of the watermarks correspond- 
ing to a different block of the picture of data; 
detemiining a picture type of the selected block 
of frequency component data; 
determining a watemnark level depending on 
the picture type of the selected block of fre- 
Quency component data; 
selecting a watemiark from the pluralrty of 
watermarks depending on which block is 

selected; and • „ .h^ 

inserting a selected watem^ark havmg the 
watemiark level into the selected block of fre- 
quency component data. 



3. A method for inserting a watemnark into a selected 
block of frequency component data in a picture of 
data having one of a plurality of picture types, com- 
prising the steps of: 

a) storing a plurality of watermarks for each of 
the picture types, wherein a watermark level of 
the watermarks varies depending on a picture 



type; 

b) selecting a watemnark of a type depending 
on a picture type of the selected block of fre- 
quency component data; and 
5 c) inserting a watemiark of a selected type into 

the selected block of frequency component 
data. 

4 A method for inserting a watemnark into a selected 
block of frequency component data in a piaure of 

data having one of a plurality of picture types, com- 
prising the steps of: 

a) storing a reference watermark; 

b) determining a picture type of the selected 
block of frequency component data; 

c) changing a watemiark level of the reference 
watenr^ark depending on the picture type of the 
selected block of frequency component data to 
produce a watermark to be used; and 

d) inserting the watermark to be used into the 
selected block of frequency component data. 

5. The method according to claim 1,2.3 ^^/'■ ^'^^^l 
the picture types are Intra-frame coding picture 
(hereafter, l-picture). Inter-frame Pred.ctve coding 
pi«ure (hereafter, P-picture) and Bidi^ctionally 
Predictive coding picture (hereafter. B-p|Ctura) 
wherein a relative proportion of watemnark levels of 
l-picture, B-picture. and P-picture is 10:7:5. 

The method according to claim 4 or 5. wherein in 
the step (0. the watermark level of ^^-jei^-'^^ 
watermark is changed depending on both the p.c 
ture type of the selected block of frequency compo- 
nent data and the selected block. 

A system for inserting a watemnark Into a selected 
block of frequency component data in a picture of 
data having one of a plurality of picture types, com- 
prising: 

a table storing a plurality of watermarks for 
each of the picture types, wherein a watermarK 
level of the watermarks varies depending on a 
picture type; 

a selector for selecting a watermark of a type 
depending on a picture type of the selected 
block of frequency component data; and 
an inserting section for inserting a se eded 
wateimark of a selected type into the selected 
block of frequency component data. 

8. A system for inserting a watermark into a selected 
55 block of frequency component data in a 

data having one of a plurality of picture types, com- 
prising: 
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a memory storing a reference watermark; 
a determiner for determining a picture type of 
the selected block of frequency component 
data; 

a multiplier for multiplying a watennark level of 5 
the reference watermark by a factor varying 
depending on the picture type of the selected 
block of frequency component data to produce 
a watermark to be used; and 

an inserting section for inserting the watermark io 
to be used into the selected block of frequency 
component data. 

9. The system according to claim 8, wherein the pic- 
ture types are Intra-frame coding picture (hereafter, is 
l-picture), Inter-frame Predictive coding picture 

. (hereafter, P-picture) and Bidirectionally Predictive 
coding picture (hereafter, B-picture), wherein a rel- 
ative proportion of factors corresponding to l-pic- 
ture. B-picture, and P-pteture is 1 0:7:5. 20 

10. The system according to claim 8 or 9. wherein the 
multiplier multiplies a watermark level of the refer- 
ence watermark by a factor varying depending on 
both the picture type of the selected block of fre- 25 
quency component data and the selected block. 

11 . A method for detecting a watermark from a selected 
block of frequency component data in a picture of 
data having one of a plurality of picture types, com- 30 
prising the steps of: 

storing a plurality of watermarks for each of the 
picture types, wherein a watermark level of the 
watermarks varies depending on a picture 35 
type; 

extracting a watermark from the selected block 
in the picture of data; 

selecting a watermark of a type depending on a 
picture type of the selected block; and 40 
determining whether the stored watermark is 
embedded in the selected block, based on an 
extracted watermark with a selected water- 
mark. 

45 

12. A digital watermarking method comprising the 
steps of: 

at a watermark inserting section for inserting a 
watermark into a selected block of frequency so 
component data in a picture of data having one 
of a plurality of picture types, 
storing a plurality of watermarks for each pic- 
ture type, each of the watermarks correspond- 
ing to a different block of the pcture of data; 55 
determining a picture type of the selected block 
of frequency component data; 
detenrtining a watermark level depending on 
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the picture type of the selected block of fre- 
quency component data; 
selecting a watermark from the plurality of 
watermarks depending on which block is 

selected; and 

inserting a selected watermark having the 
watermark level into the selected block of fre- 
quency component data, and 
at a watermark detecting section for detecting a 
watermark from a selected block of frequency 
component data in a picture of data having one 
of a plurality of picture types, 
storing a plurality of watermarks for each of the 
picture types, wherein a watermark level of the 
watermarks varies depending on a picture 
type; 

extracting a watermark from the selected block 
in the picture of data; 

selecting a watermark of a type depending on a 
picture type of the selected block; and 
determining whether the stored watermark is 
embedded in the selected block, based on an 
extracted watermark with a selected water- 
mark. 

13. A digital watermarking method comprising the 
steps of: 

at a watermark inserting section for inserting a 
watermark into a selected block of frequency 
component data in a picture of data having one 
of a plurality of picture types, 
storing a reference watermark; 
determining a picture type of the selected block 
of frequency component data; 
changing a watermark level of the reference 
watermark depending on the picture type of the 
selected block of frequency component data to 
produce a watermark to be used; and 
inserting the watermark to be used into the 
selected block of frequency component data, 
and 

at a watermark detecting section for detecting a 

watermark from a selected block of frequency 

component data in a picture of data having one 

of a plurality of picture types, 

storing the reference watermark; 

determining a picture type of the selected block 

of frequency component data; 

changing a watermark level of the reference 

watermark depending on the pk:ture type of the 

selected block of frequency component data to 

produce a watermark to be used; 

extracting a watermark from the selected block 

in the picture of data; 

selecting a watermark of a type depending on a 
picture type of the selected block; and 
determining whether the stored watemiark is 
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embedded in the selected block, based on an 
extracted watermark with' a selected water- 
mark. 

14. A digital watermarking system comprising: s 

a watermark inserting device for Inserting a 
watermark into a selected block of frequency 
component data in a picture of data having one 
' of a plurality of picture types; and w 
a watermark detecting device for detecting a 
watermark from a selected block of frequency 
component data in a picture of data having one 
of a plurality of picture types, 

wherein is 
the watermark inserting device comprises: 
a first table storing a plurality of watermarks for 
each of the picture types, wherein a watermark 
level of the watermarks varies depending on a 
picture type; 20 
a first selector for selecting a watermark of a 
type depending on a picture type of the 
selected block of frequency component data; 
and 

an inserting section for inserting a selected 2S 
watermark of a selected type into the selected 
block of frequency component data, and 
the watermark detecting device comprises: 
a second table for storing the plurality of water- 
marks for each of the picture types, wherein a 30 
watennark level of the watermarks varies 
depending on a picture type; 
an extractor for extracting a watennark from the 
selected block in the picture of data; 
a second selector for selecting a watermark of 35 
a type depending on a picture type of the 
selected block; and 

a determiner for determining whether the 
stored watermark is embedded in the selected 
block, based on an extracted watermark with a 40 
selected watermark. 



a first multiplier for multiplying a watennark 
level of the reference watermark by a factor 
varying depending on the picture type of the 
selected block of frequency component data to 
produce a watermark to be used; and 
an inserting section for inserting the watermark 
to be used into the selected block of frequency 
component data, and 

the watennark detecting device comprises: 
a second memory storing the reference water- 
mark; 

a second determiner for determining a picture 
type of the selected block of frequency compo- 
nent data; 

a second multiplier for multiplying a watermark 

level of the reference watermark by a factor 

varying depending on the picture type of the 

selected block of frequency component data to 

produce a watermark to be used; 

an extractor for extracting a watermark from the 

selected block in the picture of data; 

a selector for selecting a watermark of a type 

depending on a picture type of the selected 

block; and 

a third determiner for detemnining whether the 
stored watermark is embedded in the selected 
block, based on an extracted watennark with a 
selected watermark. 



15. A digital watermarking system comprising: 

a watermark inserting device for inserting a 45 
watermark into a selected block of frequency 
component data in a picture of data having one 
of a plurality of picture types; and 
a watermark detecting device for detecting a 
watermark from a selected block of frequency so 
component data in a picture of data having one 
of a plurality of picture types, 
wherein 

the watermark inserting device comprises: 

a first memory storing a reference watermark; ss 

a first determiner for determining a picture type 

of the selected block of frequency component 

data; 
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Therefore, a moving-picture can be effectively embed- 
ded with a digital watermark without substantially reduc- 
ing the quality of image and the digital watermark can 
be detected reliably A relative proportion of watermark 
levels of l-picture. B-picture. and P-pkrture is preferably 
set to 10:7:5. 
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